Support Vector Machines with Binary Tree Architecture for Multi-Class Classification
نویسندگان
چکیده
Abstract— For multi-class classification with Support Vector Machines (SVMs) a binary decision tree architecture is proposed for computational efficiency. The proposed SVMbased binary tree takes advantage of both the efficient computation of the tree architecture and the high classification accuracy of SVMs. A modified Self-Organizing Map (SOM), KSOM (Kernel-based SOM), is introduced to convert the multi-class problems into binary trees, in which the binary decisions are made by SVMs. For consistency between the SOM and SVM the K-SOM utilizes distance measures at the kernel space, not at the input space. Also, by allowing overlaps in the binary decision tree, it overcomes the performance degradation of the tree structure, and shows classification accuracy comparable to those of the popular multi-class SVM approaches with “one-to-one” and “one-to-the others”.
منابع مشابه
Automatic Construction Algorithm for Multi-class Support Vector Machines with Binary Tree Architecture
Multi-class support vector machines with binary tree architecture (SVM-BTA) have the fastest decision-making speed in the existing multi-class SVMs. But SVM-BTA usually has bad classification capability. According to internal characteristics of feature samples, this paper uses resemblance coefficient method to construct automatically binary tree to incorporate multiple binary SVMs. The multi-cl...
متن کاملMulti-class Classification Using Support Vector Machines in Binary Tree Architecture
This paper presents architecture of Support Vector Machine classifiers arranged in a binary tree structure for solving multi-class classification problems with increased efficiency. The proposed SVM based Binary Tree Architecture (SVM-BTA) takes advantage of both the efficient computation of the tree architecture and the high classification accuracy of SVMs. Clustering algorithm is used to conv...
متن کاملFault diagnosis in a distillation column using a support vector machine based classifier
Fault diagnosis has always been an essential aspect of control system design. This is necessary due to the growing demand for increased performance and safety of industrial systems is discussed. Support vector machine classifier is a new technique based on statistical learning theory and is designed to reduce structural bias. Support vector machine classification in many applications in v...
متن کاملEfficient Decision Trees for Multi-class Support Vector Machines Using Entropy and Generalization Error Estimation
We propose new methods for Support Vector Machines (SVMs) using tree architecture for multi-class classification. In each node of the tree, we select an appropriate binary classifier using entropy and generalization error estimation, then group the examples into positive and negative classes based on the selected classifier and train a new classifier for use in the classification phase. The pro...
متن کاملProbabilistic outputs for a new multi-class Support Vector Machine
Support Vector Machines are learning paradigm originally developed on the basis of a binary classification problem with signed outputs ±1. The aim of this work is to give a probabilistic interpretation to the numerical output values into a multi-classification learning problem framework. For this purpose, a recent SV Machine, called `-SVCR, addressed to avoid the lose of information occurred in...
متن کامل